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Related Applications 

5 This application claims priority under 35 U.S.C. §1 19(e) to U.S. Provisional Application 

No. 60/203,849, filed May 12, 2000, which is herein incorporated by referenced in its entirety. 
Background 

A. Technical Field 

This application relates to a system and method for real-time resource allocation and, 
10 specifically, to a system and method for allowing real-time buyers and sellers to bid for resources 
and controlling the applicable resources in accordance with the bids. 

B. Background of the Invention 

l/f Over the past several years, the Internet has become an important mechanism for 

15 conducting business. It has helped reduce business cost and enabled the customized delivery of 
Til goods and services. To facilitate exchange of goods and services, electronic commerce 

s; technologies have been developed, ranging from simple Internet shopping sites to auction sites 

such as Yahoo (http://www.yahoo.com) and eBay (http://www.ebay.com) . 
H At the same time, a small but growing market for telecommunication network bandwidth 

m 

q 20 has developed. Bandwidth, however, is unlike traditional commodities, goods and services, in 
that: 1) it is a shared resource that cannot be stored. As such, any bandwidth capacity unused by 
one party can be made available to all other parties having access to it or it is lost. 2) The 
resource of bandwidth is consumed in real time. That is, it can occur simultaneously with the 
buying of the resource. 3) Demand for bandwidth fluctuates very rapidly and tends to be elastic. 
25 Recently, the need for a dynamic bandwidth commodity market has been recognized. 

Bandwidth exchanges have been developed between new network companies and Internet 
service providers. The old system of signing lengthy contracts after weeks or months of 
negotiation does not move fast enough for buying and selling of many Internet-related resources, 
such as bandwidth. 

30 The allocation of information service resources can be viewed as an exchange of 

commodities. In particular, in the case of bandwidth, Dow Jones has announced plans to launch 
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a bandwidth index that will provide price for long-haul data routes and will enable companies to 
use these figures to peg the changing process for contracts when they are buying access to 
networks. 

The emerging telecommunications market call for new mechanisms for real-time trading 
5 of network resources, such as bandwidth. In a convention human-based resource trading system, 
resources for sale are posted, such as on a bulletin board or similar online location. Human 
beings peruse the posted resources and try to decide which resources their organizations will 
need in the future. The humans then place bids against each other for the resources. Such 
human-based resource trading systems usually operate on large amounts of bandwidth at a time 
10 and trades are performed periodically, the period being fairly long due to the limits of human 
attention span and speed. For example, it would be impractical for a human-base trading system 
to buy and sell resources in one minute or five minute partitions, since human beings are not 
capable of such speed. In addition, most human-based resource agents rely on additional human 
interaction to implement the results of the resource bidding. 

15 

Summary of Embodiments of the Invention 

The present invention provides a platform for resource allocation in real-time. One or 
more software resource agents interact with software player agents, which are usually both s and 
seller agents, to reach an agreement on price and quantity allocations for each buyer of that 

20 resource (for example, X Mbs of bandwidth for Y units of time, at price Z for buyer A). The s 
operate in accordance with one or more strategy rules for that agent. A strategy rule tells the 
what strategy to use in bidding against other agents for particular resources. The s also operate 
in accordance with valuation rules that tell the how to value a particular resource when bidding 
(this value is often used as a part of the strategy rule). Seller agents also contain their own 

25 strategy and valuation rules, which allow them to decide how much of a resource to offer and 

how to set a minimum price for the resource. Both player agents (buyer and sellers) and resource 
agents are aware of a global allocation rule used by the resource agent to allocate a resource 
between the buyers. In the buyer and seller agents, this allocation rule is often considered in 
determining strategy. 

30 
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In the described embodiment, player agents (buyer and seller) also contain a graphical 
user interface that allows human beings to set their rules and to control various aspects of the 
player agent. 

In general, the present invention promotes the sharing of a limited resource, such as 
bandwidth, buffer space, memory space, storage, or processor time, in a competitive 
environment. This environment ensures that whomever need the most resource and has the 
ability to pay will get a share of the resource in accordance with willingness to pay. In addition, 
the invention adjusts for the changing needs of the participants over time. 

Advantages of the invention will be set forth in part in the description which follows and 
in part will be apparent from the description or may be learned by practice of the invention. The 
objects and advantages of the invention will be realized and attained by means of the elements 
and combinations particularly pointed out in the appended claims and equivalents. 

Brief Description of the Drawings 

Fig. 1 is a block diagram of an embodiment of the present invention. 

Fig. 2 is a flow chart of a method performed by a resource agent of Fig. 1 . 

Fig. 3 is a flow chart of a method performed by a of Fig. 1. 

Fig. 4 is a flow chart of a method performed by a seller agent of Fig. 1. 

Fig. 5 is a chart showing an example of the result of an allocation rule. 

Figs. 6(a) and 6(b) show an example of a valuation rule. 

Fig. 7(a) and 7(b) show an example of a strategy rule. 

Fig. 8 shows an example of a flow chart used by an accounting system of an embodiment 
of the invention. 

Fig. 9(a) is a more detailed block diagram of the embodiment of Fig. 1. 

Fig. 9(b) shows an example of how a bandwidth resource is given to the winning bidder. 

Fig. 10 shows an example of an embodiment of the present invention including a 
"garage" for player agents. 

Figs. 1 1(a)- 1 1(b) are an example of an XML file for a generic player agent. 

Figs. 12(a)- 12(c) shown an example of Java code implementing a strategy rule for a , 

Figs. 13(a)-13(c) show an example of Java code implementing an allocation rule for a 
resource agent 104. 



3 



::ODMA\PCDOCS\DOCS\l 17247l\2 



Fig. 14 is an example of an XML file for a generic resource agent. 

Figs. 15(a)-15(r) show examples of user interfaces for buyer and seller agents. 

Detailed Description of Embodiments 
5 Reference will now be made in detail to several embodiments of the present invention, 

examples of which are illustrated in the accompanying drawings. Wherever practicable, the 
same reference numbers will be used throughout the drawings to refer to the same or like parts. 

The present invention uses distributed, self-optimizing software agents to perform 
resource allocation more efficiently than centralized or human-based systems. 
10 Fig. 1 is a block diagram of an embodiment of the present invention. Fig. 1 includes a 

software player agent 102, which represents multiple and seller agents. A typical system will, 
O include both buyer and seller agents 102. Fig. 1 also includes a software resource agent 104, a 

|j| software accounting agent 106, a network control and management agent 108 and a resource 

•* f l 110. It is contemplated that resource 110 can be a number of different resources, including but 

hi 15 not limited to: bandwidth, buffer space, memory space, storage, or processor time. As shown in 

ill 

j j| Fig. 1, each player agent (buyer and seller agent) can contain a Graphical User Interface (GUI) 

L 122, one or more valuation rules 124, one or more strategy rules 126, and one or more allocation 

3 9 
tsar 

III rules 128. The resource agent 104 also contains the same one or more allocation rules 128. 

\ssit 

<! I s 102 place bids to the resource agent 104, which ultimately decides which of the player 

20 agents is awarded a portion of each resource for a predetermined amount of time. 

Resource agent 104 also controls resource 110, based on the results of the bidding, by 
sending an allocation command to network control and management agent 108. Thus, for 
example, if the resource is Internet bandwidth, if buyer A has won X Mbs of bandwidth for 5 
minutes, resource agent 104 directs the network control and management agent 108 to give 
25 precedence to packets originating at buyer A for the next five minutes or to ensure that the 
agreed upon bandwidth requirements are met for buyer A's packets for the next five minutes. 
The mechanism used to communicate the allocation command from resource agent 104 to agent 
108 can be any appropriate mechanism. In the example shown, the allocation command will 
include an identification of the winning buyer or buyers and an identification of the amount of 
30 resource allocated and the time period for which it is allocated. Other appropriate formats can be 
used without departing from the spirit of the invention. In some embodiments, agents 104 and 
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108 are separate agents (as shown in the figure). In other embodiments, their functions are 
merged into a single agent. Agents 104 and 108 can be owned and/or controlled by the same 
entity or by different entities. For example the owner of resource 110 could outsource the 
market-based allocation to a business partner operating resource agent 104, while keeping the 
5 network management and control function in its own hands, by retaining operation of the 
network control and management agent 108 themselves. 

In the embodiment shown, network control and management agent 108 controls resource 
1 10 to implement the allocation command received from resource agent 104. Thus, agent 108 
commits the resource allocated to a player after the resource agent 104 has closed the bidding. 
10 Network control and management agent 108 provides a common interface for resource agent 104 
£» % for all systems supported. In certain embodiments, there is one agent 108 per resource, 
'fi Alternately, a single agent can control multiple resources and communicate with multiple 

III 

III resource agents 104. In the embodiment shown, network management and control agent 108 

an 

7^1 controls resources belonging to other entities (i.e., not to the owner of resource agent 104). In 

^ 15 other embodiments, resource 110 might also be under the direct control of the owner of resource 
5f agent 104. 

Fig. 1 shows that network control and management agent 108 sends either Simple 

j j| Network Management Protocol (SNMP) commands or COPS (Common Open Policy Service 

I- 1 

lab- Protocol) commands to the resource. The SNMP protocol is well known and is described in 

20 RFC 1089, RFC 1270, RFC 1303, RFC 1298, RFC 1418, and RFC 1419, which are incorporated 
herein by reference in their entirety. The COPS protocol is well known and is described in "The 
COPS (Common Open Policy Service," dated March 5, 1999, available from Adobe Systems, 
Inc. of San Jose, CA, and RFC 2748., both of which are incorporated herein by reference in their 
entirety. Other appropriate resource control protocols can be used without departing from the 
25 spirit of the invention. 

Once one or more winning buyers are determined, resource agent 104 alerts accounting 
agent 106, which keeps track of the winning buyers, as described below in connection with Fig. 
9(a). Accounting agent 106 provides a common interface for all accounting systems supported. 
Agent 106 preferably contains a database handler for each system it supports. Although 
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accounting agent 106is shown as using one or more of the IHN and SQL database interfaces, any 
appropriate interface to an accounting database could be used. 

The 102 operates in accordance with one or more strategy rules for that agent. A 
strategy rule tells the what strategy to use in bidding against other agents for particular resources 
5 and, therefore constitutes a bidding mechanism for agents. 

The s also operate in accordance with valuation rules that tell the how to value a 
particular resource when bidding (this value is often used as a part of the strategy rule). Thus, a 
valuation rule typically tells an agent how to value each unit of a resource over a range of 
possible quantities, at a given time. Seller agents also contain their own strategy and valuation 
10 rules, which allow them to decide how much of a resource to offer and how to determine a 
minimum price for the resource. Strategy and valuation can depend on external information, 
O such as accounting information and network congestion. 

The valuation and strategy of player agents (buyer and sellers) and resource agents are 
y aware of a global allocation rule used by the resource agent to allocate a resource between the 
y 15 buyers. In the buyer and seller agents, this allocation rule is often considered in determining 

31 3 

j :J valuation and/or strategy. Thus, an allocation rule typically can be thought of as corresponding to 

^ a market mechanism. Examples of allocation rules include English auctions (familiar to persons 

jjj who frequent human-based antique and estate sale auctions), Reverse Price Auctions (such as the 

t ] main eBay model), Dutch auctions, and continuous bid-ask trading. Examples of allocation 

CI 20 rules are found, for example, in 1) J.F. Rosenschein and G. Zlotkin, "Rules of Encounter," MIT 
im- 
press 1994; 2) PhD thesis of N. Semret, "Market Mechanisms for Network Resource Sharing," 

Dept. of Electrical Engineering, Columbia University, submitted approximately May 1999; and 

3) H.R. Varian, "Economic Mechanism Design for Computerized Agents," USENIX Workshop 

on Electronic Commerce, July 1995. Each of these three references is incorporated herein in its 

25 entirety. 

Fig. 2 is a flow chart of a method performed by resource agent 104 of Fig. 1. In at least 
certain embodiments, there is more than one resource agent - one for each resource. For 
example, if an ISP offers several different bandwidths, each bandwidth might be considered a 
separate resource, controlled by a separate resource agent 104. Resource agents preferably run 
* 30 within servers that can be distributed over a network. Alternately, one or more resource 
managers 104 can reside on the same system. 
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As shown in Fig. 2, resource agent 104 receives 202 one or more bids for resource 110 
from one or more s 102. Such bids will usually include at least quantity and price values. If a 
buyer is outbid, the resource agent notifies 204 the buyer, unless the trading period is over 206. 
Once the trading period is over, the resource agent notifies 208 the winning or agents and 
5 proceeds to send an allocation command 210 to network control and management agent 108 that 
will cause agent 108 to control the resource in accordance with the winning bids. 

Fig. 3 is a flow chart of a method performed by player/buyer 102 agent of Fig. 1. First, 
the is apprised of potential resources available for bidding. This is accomplished either by the 
player requesting current resource auction information from a centralized directory service (not 
1 0 shown) or by the player registering with the resource agent and periodically being sent 

information about current bidding. With a directory service, a player agent 102 queries the 
directory service to find the location (e.g., in the form of a URL) of resource agents 104, garages 
(see Fig. 10), and other player agents 102. The decides 302 whether to bid on a particular unit 
or resource 110 and sends 304 a bid to the resource agent. If the receives a notice that he has 
m 1 5 been outbid, control returns to element 302 and the agent decides whether to continue bidding. 
\\l In element 302, the uses its knowledge of the system market allocation rule and of its 

* own valuation rules to determine how much it is willing to pay for resources at a given time and 

n 

ijl uses its own strategy rules to determine whether to bid on available resources. If the includes a 

1^ GUI, a human being can visualize the market using various known graphs, charts or similar 

□ 20 graphics. A user can also use the GUI to change the strategy and valuation rules used by the 
agent. 

It should be noted that certain embodiments include a special type of player/, called a 
broker agent, which buys resources with the intent of reselling those resources.. Thus, for 
example, a broker agent has no user for the resource (such as bandwidth) itself, since the broker 
25 is not an ISP or similar entity in need of bandwidth. Instead, the broker arranges for third party 
customers, such as ISPs, to receive the benefit of the resources the broker has bid for and won, 
by reselling them through another resource agent instance, and the broker keeps the difference 
between the buying and selling price.. In such a case, the new resource agent 104 informs the 
network control and management agent 108 which party is to benefit from the resource bid for 
'30 by the broker. Fig. 4 is a flow chart of a method performed by a player/seller 102 agent of Fig. 
1 . A seller agent first notifies 402 the resource agent that it has one or more units of a resource 
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to sell (for example, IMbs for 5 minutes or 10 minutes of processor time). Once the bidding is 
over, seller agent 102 will receive from resource agent 104 a notification 404 of the winning 
bidder or bidders. In at least one embodiment, the seller agents collect the payments from the 
buyers based on accounting information retrieved from the accounting agent. 106. 
5 Fig. 5 is a chart showing an example of the result of a Progressive Second Price Auction 

(PSP) allocation rule. Other allocation rule types, as discussed above, can also be used, as 
specified by the particular allocation market strategy implemented in a particular system. Fig. 5 
shows how resources are allocated and prices set once the bidding is over and it is determined 
that there are not enough resources to satisfy all the bidders. 
10 In the PSP auction of Fig. 5, bidder A bids $3 for 50 resource units; bidder B bids $2 for 

30 resource units; bidder C bids $1 for 30 resource units; and bidder D bids $0.50 for 20 resource 
G units. At the close of bidding, resource agent 104 allocates the resources as follows: The 100 

m available resource units are apportioned between the bidders until the resource is gone. Thus, the 

inir 

high bidder A is allocated all of the resource that he wants, as is the second high bidder B. 

ixl 15 Bidder C only gets 20 or the 30 resource units that he wanted and bidder D gets nothing, since 

lij 

jij there are no more resource units to allocate after partially fulfilling bidder C's wants. 

^ The resource agent 104 determines the amount that the bidders in the PSP auction are 

U] charged as follows: For each bidder, the resource agent determines the value of the bidder's 

j» I resource if that bidder had not participated, and charges the bidder a price based on this 

20 determination. 

Thus, if bidder A had not participated, his 50 units would have been allocated as follows: 
10 units to bidder C (to make up C's shortfall) 
20 units to bidder D (to give D his requested number of units) 
The remaining 20 of bidder A's units would not have been allocated. 
25 The cost to bidder A is determined as follows: 

The cost of a resource unit to bidder C is $1/30. 

Thus, the value that would have been given to bidder C: 10 x ($1/30) = $0.33 

The cost of a resource unit to bidder D is $0.50/20. 
* 30 Thus, the value that would have been given to bidder D: 20 x ($0.50/20) = $0.50 
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Thus, the cost of A's resources had A not participated is $0.33 + $0.50 = $0.83. Bidder 
A is charged this amount for his 50 units of resource. 

Similarly, if bidder B were not present, his 30 units would have been allocated as 
follows: 

5 10 units to bidder C (to make up C's shortfall) 

20 units to bidder D (to give D his requested number of units) 

The cost to bidder B is determined as follows: 

10 The cost of a resource unit to bidder C is $1/30. 

Thus, the value that would have been given to bidder C: 10 x ($1/30) = $0.33 

^ The cost of a resource unit to bidder D is $0.50/20. 

Ill 

fJ! Thus, the value that would have been given to bidder D: 20 x ($0.50/20) = $0.50 

ill 15 

Hj Thus, the cost of B's resources had B not participated is $0.33 + $0.50 = $0.83. Bidder B 

: : is charged this amount for his 30 units of resource. 

□ 

m 

N; Similarly, if bidder C were not present, his 20 units would have been allocated as 

O 20 follows: 

iSC 20 units to bidder D (to give D his requested number of units) 

The cost to bidder C is determined as follows: 

Value that would have been given to bidder D: 20 x ($0.50/20) = $0.50 

25 Thus, the cost of C's resources had C not participated is $0.50. Bidder C is charged this 

amount for his 20 units of resource. 

It should be noted that Fig. 5 shows only how resources are allocated after bidding is 
closed. An allocation rule also includes within it rules or explanations of how the auction itself 
should be conducted. For example, a PSP auction generally lasts for a predetermined amount of 

30 time (for example, five minutes). While the bidding is open, resource agent 104 collects all bids 
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received from the s 102 and saves them in a bidlist data structure (e.g., a linked list). The bidlist 
data structure indicates which bid is the most recent bid for each 102. 

As bids are received from the s 102 by the resource agent 104, the resource agent 104 
transmits the bids received to the other agents 102, so that all agents know what all other 
participating agents are bidding. Because each 102 has knowledge of the allocation method, 
each 102 can apply its strategy and valuation rules to determine whether that agent is going to be 
allocated the resources on which it has bid. The agent, applying the allocation, strategy, and 
valuation rules, determines whether it should bid again. In a PSP auction, bidding usually 
stabilizes after a few minutes. In some embodiments, resource agent 104 does not hold the 
auction open for a predetermined time, but instead waits a predetermined amount of time after 
the bidding has stabilized to make sure that no other bids are received. In some cases, resource 
agent 104 announces to the s 102 that bidding will close in a certain number of minutes or 
seconds. In some cases, if a bid is received during this time period, the auction is kept open a bit 
longer. 

Thus, an allocation rule (known to all agents) also includes information about how the 
auction will be conducted by resource agent 104, including, for example: how long an auction 
will last, if the auction has no set time period, what are the conditions for the auction to close. In 
addition, as described above, the allocation rule includes rules describing how price and 
quantities are assigned after the auction has closed. 

In a preferred embodiment of the invention, auctions last 5 minutes, although other 
periods of time could be used and these periods of time could be either variable or user-settable. 
In a preferred embodiment, the bandwidth resource being auctioned during a current auction is 
allocated immediately and another auction is begun immediately. Thus, an auction occurs 
roughly every five minutes for the bandwidth that will be used by the buyers during the next five 
minutes. Other embodiments may not auction all bandwidth for immediate use. 

The PSP auction model is described further in A. A. Lazar and N. Semret, "Design and 
Analysis of the Progressive Second Price Auction for Network Bandwidth Sharing," 
Telecommunications Systems, Special issue on Network Economics, which is attached hereto as 
Appendix A and forms a part of this application. 

Other examples of allocation rules include, but are not limited to a Hold Option Auctions, 
which are discussed, for example, in the PhD thesis of N. Semret, "Market Mechanisms for 
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Network Resource Sharing," Dept. of Electrical Engineering, Columbia University, submitted 
approximately May 1999, Chapter 4 of which (28 pages) is attached hereto as Appendix B and 
which forms a part of this specification. The Hold Option is a concept for advance price and 
quantity guaranteed reservations of network resources in a real-time market environment. 
5 Periodic auctions (progressive second price, or other) among arrivals grouped in batches give 
rise to the spot market of capacity changes. A reservation guaranteeing access for an arbitrary 
duration with a capacity piece below the bid can be made at any time before or during service. 
This eliminates the risk (which is inherent on the spot market) of losing resources to higher 
bidders before service completion. The reservation is defined as a hold option, and is analogous 
10 to derivative financial instruments such as options and futures integrated over time. Based on a 
heavy traffic diffusion model, reservation fees can be computed as the fair market price of a hold 
Pi option. In at least one embodiment, special player agents 102 are allowed to place such hold 
Jjf" options, thus providing a guaranteed reservation of a network resource for an arbitrary duration. 
U! Figs. 6(a) and 6(b) show examples of valuation rules. In Fig. 6(a), a valuation rule is 

u] 1 5 formed of pairs of quantity /price values. In Fig. 6(b), a valuation rule is formed as a function of 
;~f various input variables. These input variables can include any or (but are not limited to): the 

number of hits on a web site ; the average file size downloaded (and the bandwidth needed to 
ii5 service those files); the expected delay or expected latency, and the value of each hit. Valuation 

can also be time dependent (e.g., higher valuations are assigned during peak usage times when 
rj 20 more bandwidth is needed) and the network state (e.g., more bandwidth is needed if the network 
r " a is congested). 

It should be noted that there are engineering tradeoffs for the type of valuation rule used. 
Because a low-level valuation rule requires more inputs, which require more time and effort to 
collect and receive, a low-level description may require a large amount of data to be transferred 
25 in order for the agent to be able to bid in accordance with the low-level valuation rule. On the 
other hand, a simple, high-level valuation rule reduces the ability of an agent to make an 
optimum bid because the agent is operating with less information. Either implementation can be 
correct for a given circumstance, depending on the needs of the particular player agent and the 
limitations of its system and network. 
30 Figs. 7(a) and 7(b) shows examples of strategy rules. Fig 7(a) shows a simple rule set, 

where the first precedent is to identify the type of allocation system being used. Once the 
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allocation system if identified, the 102 applies a set of predefined conventional rules to 
determine whether it should bid (or bid again). Fig. 7(b) shows an example where the strategy is 
based on a user-defined function. In the example, if the function reaches a threshold value, the 
agent 102 will bid (or bid again). Other examples of strategy rules decide not just whether the 
5 agent should bid, but how much the agent should bid, in accordance with the allocation rule 
being used by the system and in accordance with factors specific to that agent (such as, for 
example, those factors discussed above in relation to valuation rules). 

Certain strategy rules are very simple and involve bidding constant amount. Such simple 
strategy rules may result in uneven amounts of bandwidth being won. Another example strategy 
10 rule is periodic bidding, in which a buyer agent enters auctions periodically. 

Fig. 8 shows an example of a flow chart used by an accounting system of an embodiment 
O of the invention. The accounting system is notified whenever a resource agent closing bidding 

^ on a resource unit and keeps track 802 of the winning bids and resulting allocations. 

u$ 

III Periodically, the accounting system bills 804 the seller a percentage of the resources sold, which 
y 15 is received by the owner of the resource agent for operating the resource agent and account 

\\ 9 agents of the Merkato platform. 

* Fig. 9(a) is a more detailed block diagram of the embodiment of Fig. 1 . It will be 

O 

it I understood that Fig. 9(a) details only one possible way to implement the present invention and 

If that the description herein is not to be taken in a limiting way with regard to operating systems, 

III 

O 20 protocols, programming languages, etc. The example shown is implemented in Java using the 
*™ World Wide Web, but the invention is not limited to such a system. In fact, the invention can be 

implemented on any appropriate computers and networks, using any appropriate programming 
language, hardware, software, and operating system. Parts of the system can be implemented in 
software, firmware, or hardware, as needed. 
25 Fig. 9(a) includes four layers: an operating system (OS) layer 902, a Java layer 904, a 

Merkato layer 906, and a diffex layer 108. In the described embodiment, the OS layer 902 and 
the Java layer 904 are conventional and will not be described herein. Other embodiments may 
make changes to one or more of layers 902 and 904 to enhance the performance of the system, 
for example. In this example, the use of Java layer 904 makes the system platform independent. 
30 Thus, the Merkato layer 906 can run on any computer or computing device (such as a wireless 
device , pager, cell phone, or Internet appliance) 
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Layer 906 allows a player agent 102 to be executed on the client side, from a Java 
application or an applet executing in a Web browser. Alternately (or in addition), a player agent 
102 can be executed as a servlet on a web server, which is the "garage" environment of Fig. 10. 
Layer 908 enables real-time resource markets between peering ISPs. The layer 908 
5 allows ISPs to buy and sell resources, such as bandwidth, from each other in real-time. Layer 
908 auctions in real-time the outgoing bandwidth on each ISP's line out of the exchange, ensuing 
that at all times, the bandwidth goes to the buyer with the highest value for it. Layer 908 also 
allows for buying and selling in advance (i.e., making reservations with guaranteed capacity and 
capped prices) through a derivative market of options, in effect enabling the trading of risk and 
10 hedging, for original ISP buyers and sellers, as well as for purely financial players. 

Fig. 9(b) shows and example of how a winning buyer ISP 952 is given a resource, such 
pi as bandwidth. In Fig 9(b), a seller ISP 956 has a seller 902 agent running on a diffex client. As 
fy discussed above, the seller agent determines that the ISP has bandwidth to sell (e.g., through 

111 user input via the seller agent GUI) and makes that bandwidth available for auction by sending a 

Z\ 15 message to resource agent 904 (see numeral 1 in a circle). The buyer ISPs 952, 954 have s 902 

|]f running on a diffex client. The s bid on the bandwidth in accordance with their allocation rules, 

til 

strategy rules, and valuation rules, as discussed above (see numeral 2 in a circle). For certain 
m types of allocation models, the agents also receive information about bids during the auction (not 

H shown). Once the auction is concluded, resource agent 904 sends an allocation command to 

n 20 network control and management agent 908 (numeral 3 in a circle), which in turn controls a 
|a,B router 970 of the seller ISP so that the winning buyer ISP receives its bandwidth (see numeral 4 

in a circle). 

Resource agent 104 in layer 908 interfaces with the resource (e.g., with the router 970 of 
the seller ISP) to allocate the bandwidth to the winning bidder. Specifically, resource agent 904 
25 interfaces with control agent 908 to send commands to the router of the seller ISPs. If, for 

example, the resource is bandwidth, allocation to the winning bidder can be effected by one of 
the following or by any other appropriate method: 

a) the router 970 is given a set of class-based weighted-fair queuing parameters to 
be used by the router to control packet queuing in the router so that the winning ISP buyers are 
30 assured of receiving the bandwidth which they was allocated by the resource agent. These 
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queuing parameters will give priority to the winning bidders when packets from the winning 
ISPs are sent to the seller ISP's router, 

b) the router is given a set of committed access-rate parameters to be used by the 
router to limit and shape traffic assure each buyer the bandwidth which it is allocated, or 
5 c) capacity within an MPLS (Multiprotocol Label Switching) tunnel between two 

points in the seller's network. 
Thus, as shown in Fig. 9(b), packets 960 from the winning buyer ISP(s) are routed through the 
seller's router and on to the seller ISP's network 956, from which they are delivered to their 
destination. In at least one embodiment, the winning ISPs are aware that they have won and use 
10 existing routing protocols to ensure that they direct packet traffic to the seller ISP's router. In 
other embodiments, the resource agent informs routers in the winning ISPs of the needed routing 
p change using known routing protocols. 

jjjjj. In the described embodiment, the resource agent is always executed on a Web server. 

Each resource agent 104 runs as a servlet on a Web server. This architecture is scalable because 
hi 15 resource agents 104 can be distributed to run on any Web servers supporting the concept of a 
I Jf servlet. 

5 ^ In the described embodiment, communications between a player agent (either a buyer or 

m a seller) 102 and a resource agent 104 are performed via a resource agent proxy using any of http 

extensions, native TCP protocol, or Java's remote method invocation (rmi). All communications 

; if 

O 20 are secured through an appropriate mechanism such as the secured socket layer (SSL). A shown 
in Fig. 9(a), each agent (player and resource) has an allocation rule object 128. The player 
agents 102 also have valuation rule objects 124, strategy rule objects, 126, and a GUI object 122. 
In addition, the resource agents 104 have networking and accounting drivers for interfacing with 
external support systems. Further security is provided through the implementation of specific 

25 allocation rules that protect the stability of the system. Specifically, each user is required to pay 
a bid fee to resource agent 104 for every bid sent. The implementation of a bid fee is intended to 
prevent users from trying to artificially destabilize the resource price and to prevent a "man in 
the middle" attack, which is defined as a third party intercepting a bid from another agent and 
keeping sending the same bid over and over. In addition, timestamps are preferably used to 

30 discriminate every bid. Thus, if a bid has a previously used timestamp, resource agent 104 will 
ignore that bid. 
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In the described embodiment, communication between agents is effected using http, thus 
bypassing many problems associated with firewalls, proxies, and other middleware. 

Fig. 10 shows an example of an embodiment of the present invention including a 
"garage" for player agents 102'. The garage 130 is a component on a web server that serves the 
5 purpose of storing agents and enabling their execution remotely from a user's computer. The 
garage contains an "attendant" program 131 whose job is to help mobile agents find a parking 
place in the garage and to ensure proper agent execution when the agents want to run 
autonomously. Garage 130 performs the function of a distributed database to store the agents 
102' and provides a distributed processor (not shown) to execute the agents. Garage 130 can be 
10 located on the same system as resource agent 104, but can also be located on a different machine. 
The attendant is an example of a multi-agent. Multi agents coordinate multiple simple 
n agents to act together. Multi-agents can be used to form coalitions of agents, using the attendant 

to bid for aggregated resources on behalf of the coalition. In the described embodiment, the 
111 agents communicate with the attendant to let the attendant know that they need resources. The 

SMS 

jjj 15 multi-agent aggregates the various types of resources requested (e.g., different connection speeds 
!*| or different bandwidths) and uses the allocation rule and its own strategy and valuation rules to 

bid on behalf of the agents. If the multi-agent wins, the resource is divided between the agents 

rl 

i|l and the attendant so informs the resource agent 104, which allocates the bandwidth accordingly. 

!f A broker is an example of a multiagent, coordinating buyer and seller agents for a common 

ill 

C! 20 objective to act as a profit-maximizing reseller. 

"~ In the described embodiment, agent mobility to the garage is provided through XML. 

The syntax and semantics of an agent is described using XML. For example, the semantics of an 
agent can include its allocation, strategy and valuation rules. Each agent can be transferred to the 
"garage" 130 by generating its XML description. Once an agent is provided in this form, it can 
25 be re-instantiated either in a garage 130 or in a user's computer in an applet or a java 
application. 

Figs. 1 1(a)- 1 1(b) are an example of an XML file for a generic player agent 102. This 
XML would be used, for example, to send the agent 102 to a client for execution in garage 930. 
Each of the XML tags (indicated by o brackets) identifies an attribute of the agent that is to be 
30 activated in the garage. It will be understood that the XML of Fig. 1 1 is shown for purposes of 
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example only and that other embodiments of the invention may use more or fewer tags and/or 
different tags than those shown in Fig. 11. 

Figs. 12(a)- 12(c) shows an example of Java code implementing a strategy rule for a 102. 
This example implements a strategy in accordance with the PSP auction model described above. 
5 As shown in section 1234 of Fig. 12(c), an agent using this strategy will submit a new bid only if 
the new bid determined in the rule is increased by at least a calculated value epsilon. Note that 
this strategy rule calls a valuation rule in line 1232 of Fig. 12(c). This valuation rule implements 
a PSP valuation method. 

Figs. 13 (a)- 13(c) show an example of Java code implementing an allocation rule for a 
10 resource agent 104. This example looks at a number of received bids in a bidlist data structure 
and computes an allocation (similar to that of Fig. 5) given the current bids on the bid list in 
O accordance with a PSP auction allocation model. 

iZi Fig. 14 is an example of an XML file for a generic resource agent 104. This XML would 

be used, for example, to send the resource agent 104 to a web server. Each of the XML tags 

4* 

\il 1 5 (indicated by o brackets) identifies an attribute of the agent that is to be activated on the server 

ill 

* 11 side. 

*ji 

* Figs. 15(a)-15(r) show examples of user interfaces for buyer and seller agents. Figs. 

CI 

ill 15(a) and 15(b) show an example of an html GUIs that provides static information to a user, 

i*. Figs. 15(c) and 15(d) show an example of GUIs implemented as a Java applet. The information 

CI 20 provided by these interfaces is continuously updated in real-time or periodically. Figs. 1 5(e)- 

I ;' 

15(r) show an example of an advanced GUI, which is preferably also implemented as an agent. 

Particular buyer and seller agents may have one, none, or all of the particular GUIs shown here, 

or may have GUIs providing other relevant information not shown here. Note that several of 

these GUIs allow a human user to choose the valuation and/or strategy rules and to determine 
25 when and how to bid. It should be understood that in the preferred embodiment, buyer agents 

are capable of bidding on their own. Other embodiments may contain agents that bid only at the 

direction human beings. 

Accordingly, the present invention is intended to embrace all such alternatives, 

modifications and variations as fall within the spirit and scope of the appended claims and 
30 equivalents. 
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